How can I turn off the login request for Apple Pay?

After I somehow managed to add a credit card into the wallet of my iPad, I guess it is Apple Pay, now each time my iPad goes into standby I'm asked for the Apple Pay password when I wake it. That's highly annoying! Can I shut that off?

Otherwise, how can I remove Apple Pay from the iPad?